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^^ ■ We present an inverse method to construct large classes of chaotic invariant sets together 

with their exact statistics. The associated dynamical systems are characterized by a probability 

k>( \ distribution and a two-form. While our emphasis is on classical systems, we briefly speculate 

$H ' about possible applications to quantum field theory, in the context of generalizations of stochastic 

quantization. 
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1 Introduction 

Due to the sensitive dependence of chaotic systems on initial conditions, their behavior over 
sufficiently long times is unpredictable in practice, even though the underlying dynamics is 
deterministic. Instead of attempting to accurately describe a phase space trajectory over a long 
duration, it makes more sense to try to calculate statistical properties of the system, such as 
equal time moments and the frequency with which the system coordinates lie within different 
regions of phase space. 

Typically, statistical properties are calculated by direct numerical simulation. The evolution 
of the dynamical system is observed on a computer, starting with a particular initial condition, 
and the statistics are computed from averages over data points generated at regular time inter- 
vals. It is assumed that the result converges to the exact statistics fast compared to the the rate 
at which numerical errors are amplified by the chaotic nature of the system. 

From an aesthetic point of view, direct numerical simulation is not an appealing way to 
compute statistics, since this approach is not formulated solely in terms of the variables one is 
actually interested in, namely the statistical quantities. There are equations which deal directly 
with the statistics, such as an equation due to Hopf [H [2] which governs the generating func- 
tional of equal time moments. A better known equation, related to Hopf 's equation by Fourier 
transformation, is the Fokker-Planck equation describing the time evolution of a probability 
distribution over phase space. In some special systems, such as the one described in [3], an 
analytic solution for the statistics exists, even for a very large number of degrees of freedom. 

In this article, we will describe an inverse method to construct chaotic dynamical systems, 
starting with an invariant probability distribution and a two-form having a relatively simple 
analytic structure. This method allows one to generate, in principle, infinite classes of dynamical 
systems for which some statistical properties are known exactly. While we give examples with 
three and four degrees of freedom, we do not anticipate prohibitive obstructions in applying the 
inverse method to systems with a very large number of degrees of freedom. 

Our starting point is an analytical expression for an invariant probability distribution p{x) 
which is, by construction, a smooth measure in an A^ dimensional phase space. It well known 
that the geometry of a chaotic invariant set may be fractal, having a fractional information 
dimension less than A^. However, even with information dimension less than A, an invariant 
distribution with support in A dimensions may still be relevant to the statistics of a chaotic 
trajectory as a probability distribution on the chaotic invariant set upon projection to lower 
integer dimension. We give several examples where p{x) describes the statistics of chaotic 
trajectories upon projection to lower dimension. 

There are examples for which we have found numerical evidence that the initial distribution 
p{x), with N-dimensional support, gives accurate results even for connected moments (cumu- 
lants) which do not admit projection to lower integer dimension, such as < xyz >c in A = 3. 
This may be because the information dimension, which we have not yet calculated, is very nearly 
A^. However, we speculate that the Hopf functional ^{j) =< exp{ij ■ x) > may be sufficiently 
well behaved that its Fourier transform, which is by construction an invariant distribution, has 
support in A dimensions and is equal to p{x). If so, p{x) determines all polynomial moments 
< x""y"^z^ ■ • • >, although there should be other expectation values of functions on phase space 
which can not be obtained from p{x), due to the fractional information dimension. We also find 
that, in many instances, the ratio of frequencies with which different regions of phase space are 
visited by a chaotic trajectory is determined by the distribution p{x), even when the detailed 
geometry of the chaotic invariant set is quite complicated or unknown. 



Although our analysis is largely analytic, we have found that it is necessary to do some 
direct numerical simulations to determine if the initial invariant probability distribution p (or 
rather its projection to lower dimension) is ergodic. For some choices of the initial distribution 
and two-form, the dynamics is not chaotic at all, in which case p has the interpretation as 
an invariant distribution over periodic or quasi-periodic trajectories. In many other instances, 
chaotic trajectories do not visit all regions where p has support, although the initial distribution 
can be rendered ergodic by restricting the domain of support and adjusting the normalization. 

When an analytic expression can be given for the restricted domain of support, which can 
never be done with absolute certainty since these domains are determined numerically, we can 
make very well motivated conjectures for exact equal time moments. In the absence of an ana- 
lytic expression for the restricted domain, one can not make statements about exact moments. 
However, we expect that p still determines the ratios of frequencies with which a chaotic tra- 
jectory visits regions of phase space within which the chaotic invariant set has equivalent local 
geometry. 

In the present work, we will focus on dynamical systems on M^, with polynomial velocity 
fields. However the inverse method we describe may be generalizable to dynamical systems in 
spaces with other topologies, such as classical spin systems on S^ K^. 

The motivation for this work is several-fold. One intention is to provide exact solutions 
which can be used as testing grounds for theoretical ideas, and as benchmarks for approximate 
methods to compute the statistics of non-linear dynamical systems. Another intention is to 
provide a means to reverse engineer systems very close to ones of physical interest, although 
we will make no attempt to do so in this initial study. The principle difficulty in constructing 
physical systems seems to be the choice of two-form, which has no direct physical interpretation. 

The organization of this article is as follows. In section 2 we briefly review the Fokker-Planck 
and Hopf equations governing the statistics of stochastic and chaotic dynamical systems. We in- 
troduce the inverse method in section 3, and give examples of chaotic systems with three degrees 
of freedom and invariant probability distributions which are polynomial within their domain of 
support. In section 4, we give an example with four degrees of freedom. The inverse method for 
distributions with more complicated analytic structure is discussed in section 5, where we give 
an example with 3 degrees of freedom. Conditions for uniqueness of the invariant distribution 
in the context of the inverse method are discussed in section 6. In section 7, we describe the 
inverse method for dynamical systems with Gaussian noise and a class of distributions which 
arise in the context of quantum field theory. Section 8 contains concluding remarks. 

2 Review of Hopf and Fokker-Planck equations 

Consider an N dimensional dynamical system of the form 

j^Xnit) = Vn[x] + fn{t) , (2.1) 

where fnit) is a Gaussian random force for which 

[fn{t)] = , [fm{t)fn{t')] = 2r6„,n6{t - t') , (2.2) 



and the brackets [• • • ] indicate an average over the random variable. The time evolution of a 
probability distribution over phase space, p{x,t), satisfies the Fokker-Planck equation |^, 

—p{t, x) = - V • ip{t, x)vix)) + rv2 {p{t, x)) . (2.3) 

The Fourier transform of the probability distribution with respect to the phase space coor- 
dinates X is the Hopf characteristic functional [H [11 [5] 

^(j*,t) =<e'J-^W >, (2.4) 

which generates equal time moments: 

= < Xmit)Xn{t) ■ ■ ■ > , (2.5) 



H7r-)(-^7r-)---^0.^) 



j=0 



while In(^) generates the connected moments (or cumulants). The characteristic functional 
satisfies the equation 

d 
-i—^ = H^ (2.6) 

dt ^ ' 



where H^ the Hopf Hamiltonian, is given by 

ii^Y.^3■v{-^^\-^V\^j\\ (2.7) 



m,=l 



dj 



In (j2.7p . the coordinates x„ in the velocity function Vm{x) have been replaced with the operators 
—i-M-. The boundary conditions satisfied by ^ follow from the requirement that pis a probability 
distribution. For instance 

^(J=0) = 1, hm ^ = 0, (2.8) 

iJl^oo 

with additional more complicated constraints arising from the positivity of p. 
An invariant measure on phase space is one for which the statistics is static, 

|, = 0,or|* = 0. (2^9) 

Invariant measures are naturally generated by trajectories of stochastic and deterministic chaotic 
dynamical systems with no explicit time dependence. The state of a chaotic system observed 
at sufficiently long time intervals looks random. Moreover the fraction of the time with which 
the system lies in a given region of phase space is assumed to converge as the observation time 
goes to infinity. This yields a distribution which is independent of when one starts to observe 
the chaotic system. Such a distribution is invariant (static) when viewed alternatively as a 
distribution over initial conditions. Note that the converse statement that an invariant measure 
describes the statistics of a chaotic trajectory is not always true. If it is true, the measure is said 
to be ergodic. Ergodic invariant measures have no convex decomposition, meaning that p can 
not be written as (1 — x)pi + xp2 where pi^2 are independent invariant measures and < j; < 1. 
In some cases, such as the toy model of inviscid flow described in [6l[7], a zero mode of the 
Hopf Hamiltonian, satisfying H^ = 0, can be found exactly [3]. The zero mode corresponds to 



an ensemble with static statistics or, assuming ergodicity, to the statistics of a chaotic system 
observed over a sufficiently long period of timqj- The work we discuss here amounts to an 
inverse approach of picking a zero mode and finding the Hamiltoniarcl. We will work with the 
Fokker-Planck equation, picking a probability density p and finding a corresponding dynamical 
system, v{x). For the most part we will consider the deterministic case, although the application 
of the inverse method to a class of stochastic dynamical systems is discussed in section 7. 

3 The inverse method for polynomial distributions 

Consider a deterministic dynamical system in an N dimensional phase space, 

-x = v{x), (3.10) 

It is convenient to use the language of differential forms and define the velocity one-form v = 
Vndx"', in terms of which the static, zero diffusion limit of the Fokker-Planck equation can be 
written as 

d*{pv)=0. (3.11) 

One can therefore always (locally) write *{pv) = dA where ^ is an A^ — 2 forrqfl, or equivalently 

*dA 
v = ^^. (3.12) 

P 

Given any distribution p, we can find dynamical systems (characterized by v) such that p is an 
invariant distribution by making a choice of A. Since the Hodge dual of ^ is a two-form, it is 
more convenient at large N to define the dynamics in terms of the probability distribution and 
the two-form *A. A generic choice of p and A will give a velocity v which is not a polynomial 
function of the coordinates. In this article we will only consider polynomial v on the phase space 
M^. Of course non-polynomial v may also arise in various physical settings and for phase spaces 
with non-trivial topologies, such as classical spin systems. 

In order to insure that v is polynomial, let us define another N — 2 form Q. = Aj i? . Then 

*v = pd^^ldpNQ. (3.13) 

in regions where p 7^ 0. The simplest way to insure that v is polynomial is to take polynomial 
p and $7. However a polynomial p is not normalizable, unless we restrict its range of support. 
Let us therefore consider the following example for A^ = 3. 

p =\ - x^ - y^ - z^ ioY x^ ^ y^ ^ z^ <\ , 

p=Ofor x^-hy^ + z^ > 1, (3.14) 



^The probability distribution related by Fourier transformation to the characteristic functional ^ 
found in [3] does seem to be ergodic. 

^This kind of approach has been very useful in condensed matter physics, in which case one searches 
for the quantum mechanical Hamiltonian associated with a chosen ground state. 

^For readers not familiar with differential forms, one can write pv — V ^ A for the case N=3. The 
differential form language proves useful for A^ > 3. 



up to a normalization factor. To specify a dynamical system consistent with this invariant 
distribution, we must also make a choice of one form Q. Consider 



rj = {xyz)dy + {y )dz . 
With this choice, (|3.13|) gives the dynamical system: 

Vx = 13z xy — 6y — xy + 2y + yx — 2yx — 2yz + y x . 



(3.15) 



Vy = Sx-^y 



V, 

9x yz + yz — yz — y z . 



(3.16) 



Note that the equations (13.160 clearly do not permit passage across y = or z = 0. Thus 
the initial distribution, which has support for positive and negative y and z, can not be ergodic. 
Let us therefore consider a modified probability density 



p=l-x^ -y^ -z^ for y>0, z > 0, 1 - x^ - y^ - z*^ > , 
p = elsewhere. 



(3.17) 



up to normalization. Although this modification introduces delta functions in dxP and dyp at 
the X = and y = boundaries respectively, the Fokker Planck equation is still satisfied because 
Vx{x = 0) =0 and Vy{y = 0) = 0. Figure 1 shows planar projections of points generated both 
by numerical simulation of this dynamical system, starting from the initial condition (x, y, z) = 
(0.5,0.5,0.5), and by random sampling according to the probability distribution ()3.17p . At the 
crude level of visual inspection, these seem to agree. 
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Figure 1. The XY and YZ projection of points generated by the dynamical system (I3.16P ob- 
served at fixed time intervals Ai = 4 (on the left) starting from the initial condition (x, y, z) = 
(0.5,0.5,0.5) and by random sampling with the probability distribution (j3.17p (on the right). 



Numerical simulation over increasingly long time suggests that that the frequency with which 
the system lies in boxes in projections of the phase space converges to the box integral of the 
modified probability density. This last fact is a test of ergodic chaotic behavior and need not be 
generally true. If the system were not chaotic, the points generated by numerical simulation of 
the dynamics would not bear any resemblance to the points generated randomly according to the 
probability distribution. The probability distribution would then only have the interpretation 
as a distribution over initial conditions which is invariant under the evolution, but would have 
nothing to say about individual trajectories. 

Direct numerical simulation also suggests that the equal time moments of the chaotic tra- 
jectory 



„n„m I 
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Nn„,/j.\m ^fj-xl 



<a;"y"/>= lim - / dtx{t)''y{trz{ty 

T^oo T Jq 

converge to those derived from the probability density (j3.17p . 



(3.18) 



< a;"y"z' > = 



n„,m I 



(rxp{x,y,z)x'^y^z 



(3.19) 



Moments calculated by direct numerical simulation of the dynamical system (|3.16p . and by 
Monte Carlo simulation using (|3.17p are shown in table 1. 



Moments 


Dynamics 


Monte Carlo 


<y> 


0.3449 


0.3451 


<z> 


0.4223 


0.4136 


< x^ > 


0.2066 


0.2068 


<y^ > 


0.1720 


0.1717 


<z'> 


0.2387 


0.2324 


<yz> 


0.1403 


0.1386 


<y^ > 


0.1014 


0.1011 


< z^ > 


0.1531 


0.1493 


< x^y > 


0.06562 


0.06543 


<y^z> 


0.06836 


0.06721 


<yz^ > 


0.07670 


0.07571 


<x^ > 


0.08531 


0.08579 


< x'^yz > 


0.02607 


0.02564 


< x'^y'^ > 


0.03056 


0.03021 


< x^y'^z^ > 


0.0002604 


0.0002482 









Table 1. The entries in the column labeled 'dynamics' were obtained by numerical simulation 
of the dynamical system (13.160 over a time duration 100000 , sampling at intervals At = 0.01, 
starting from the initial conditions {x,y,z) = (0.5,0.5,0.5). The column labeled 'Monte Carlo' 
was obtained by a hit and miss Monte Carlo calculation using the proposed exact distribution 
with 400000 accepted data points. 



As we have seen, the initial probabihty density which is used to generate the dynamical 
system may only describe a chaotic invariant set in a restricted domain. Although the restricted 
domain is simple here (y > 0, z > 0, x^ + y^ + 2^ < 1), it can also be much more complicated 
as we will see later. Even if the ratio of frequencies with which different regions of the invariant 
set are visited by the chaotic trajectory is determined by p, one must also know the geometry 
of the invariant set to calculate equal time moments (or the Hopf functional) . 

The present chaotic system is not dissipative. Trajectories with initial conditions outside the 
range of support of the initial probability distribution ()3.14p avoid this region, or travel around 
the periphery and then move away. Thus we have reverse engineered a chaotic repeller starting 
from its statistics. Strictly speaking, since we can give numerical evidence for ergodicity of the 
distribution (j3.17p (after projection), but not prove it, we have a very well motivated conjecture 
for the exact statistics of a chaotic trajectory. 

At present, all the examples we have found of polynomial p describing chaotic trajectories 
have real zeros which form a compact manifold E. Such systems are generally non-dissipative. 
For p = (j3.13p becomes *v = 2dp A 0,, implying that the velocity is tangent to S. Thus 
trajectories outside the region bounded by the zeros of p set can not enter the region inside. 
Construction of chaotic attractors by the inverse method requires that p and the two- form *i7 
have a more complicated analytic structure, examples of which are discussed in section 5. 

The inverse approach allows one, to a limited extent, to reverse engineer chaotic invariant 
sets with a geometry of ones choosing. To illustrate some of the power and limitations of the 
approach, consider a polynomial probability distribution with support between spherical shells; 

P = P1P2 , (3.20) 

pi = i3-x^-y^-z^), (3.21) 

P2 = (x^ + y^ + z'-l), (3.22) 

in the region where (j3.2ip and (j3.22p are positive, and p = elsewhere. Together with a one 
form 

n={x + y)dy + zdx , (3.23) 

equation (j3.13p yields the dynamical system 

v^ = 8z(x2 + y^ + z'^-2){x + y), (3.24) 

Vy = -lOz'^x'^ - lOz^y^ - 9z^ + 20^2 + Ax"^ + Ay"^ - 3 - x"^ - 2x'^y^ - y^ , 
v^ = 8zyx^ + 8zy^ + 8yz^ - I6zy - to'' - 8x^y - Wx^y"^ - 8xy^ - lOx^z^ 
- 8xz^y + 20x^ + 16xy + Ay^ + 4z'^ - 3 - y^ - 2y'^z^ - z'^ . 

Constant z sections of a chaotic trajectory (figure 2) reveal considerably more structure than 
is present in the initial invariant distribution p defined in (|3.20p - ()3.22p . The chaotic invariant 
set fills regions between the concentric shells defined by p, although there are excluded regions 
within the support of p which are not visited by the chaotic trajectory. We do not have analytic 
expressions for the excluded regions. 

The initial invariant distribution used to generate dynamical systems by the inverse method 
seems to be related to the ergodic distributions associated with chaotic trajectories by a restric- 
tion of the domain of support. The restricted domain can very complicated, or even fractal. 
Without specifying properties of this domain, or its projections, one can at best give partial 



information about the exact statistics, such as the ratio of frequencies with which the chaotic 
trajectory visits different regions of phase space in which the chaotic invariant set has similar 
local geometry. To the limited numerical accuracy that we have checked for the present example, 
the frequency ratios are consistent with (J3.20p ~ (j3.22p . However, we do not have a conjecture for 
equal time moments or the Hopf characteristic functional of this system. 

Note that variations of the 2 form *i} with fixed p change the dynamics and the geometry of 
the chaotic invariant set (assuming the system remains chaotic). As an example, consider the 
distribution (I3.20p with 



rj = xyzdx + xzdy + ydz . 



(3.25) 



This gives a different dynamical system (we will not write down the rather long expression for 
the velocity field), with constant z sections of the chaotic trajectory plotted in figure 3. We 
expect that the ratio of the visitation frequencies of different regions in the chaotic invariant set 
with equivalent local geometry are still given by p in ()3.20p - (13.22p . but the equal time moments 
and the Hopf functional are different. 

The statistics, in the form of the distribution p, may exhibit symmetries which are not re- 
spected by the dynamics. The distribution in (I3.20p . has rotational 50(3) invariance, which is 
not respected by il in either (j3.23p or (|3.25p . or in the geometry of the chaotic invariant set. The 
symmetry might be observed in ratios of frequencies with which different regions of the chaotic 
invariant set are visited, if not also in the moments or the Hopf functional. Such accidental 
statistical symmetries are very common. Note that the exact Hopf characteristic functional 
given for the Orszag- Mclaughlin model in [3] shows a rotational SO{N) symmetry which the 
equations of motion do not exhibit. 
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Figure 2. z = and z = 1.1 sections of trajectories of the dynamical system defined by the 
invariant distribution (13.20p and the 1-form (J3.23P for two sets of initial conditions, one of which 
belongs to the chaotic invariant set (dense blue dots) and the other which belongs to a quasi- 
periodic trajectory (loops of red dots). This is not a Poincare section, since trajectories crossing 
the section in both directions have been plotted. The quasi-periodic orbit fills a two-torus in 
the full three dimensional phase space. 
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Figure 3. z = 0.1 and z = 1.1 sections of a chaotic trajectory associated with the dynamical 
system defined by the invariant distribution (I3.20p and the 1-form (I3.25p . 



4 A four dimensional example 



Consider the invariant polynomial probability distribution 

P = P1P2P3 
pi = l-{xl + yl)), 
P2 = l- (.xl + y2)), 
P3 = l- {xi- x^f - {yi - y2f , 



up to a normalization factor, in the region where (J4.27|) - (j4.29p are all positive, with p 
elsewhere. To uniquely specify a corresponding dynamical system, we choose a two-form 



(4.26) 
(4.27) 
(4.28) 
(4.29) 





Q. = Xiyidx2 A dy2 + X2y2dxi A dyi + xfdxi A dyi + X2dx2 A dy2 ■ 



(4.30) 



Our choice of two- form is essentially random and not motivated by any physical constraint, 
besides the requirement that the system exhibit chaos with initial conditions inside the domain 
of support of p. Note that the simpler choice of two-form, fi = xiyidx2 A dy2 + X2y2dxi A dyi 
does not lead to chaotic dynamics. Applying (|3.13p yields a velocity field with a large number 
of terms which we will not write explicitl}0. Numerically simulating the resulting ODE for an 
initial condition within the domain of suport of p suggests that the distribution p is in fact 
ergodic upon projection to lower dimension. Figure 4 shows the (xi,yi) and (2;i,a;2) planar 
projections of points generated both by running the dynamical system and by random sampling 
according to the probability distribution (j4.26p . At the crude level of visual inspection, this 
distribution is consistent with the dynamics. 



"^This system has some vague resemblance to a classical spin system. However we are not (at this 
stage) attempting to reverse engineer either a physically motivated system or a simple system with a 
small number of terms. The operations on differential forms in (j3.13p were all performed on a computer 
using code written in Python. 
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Numerical simulation also suggests that the moments associated with the chaotic trajectory 
are consistent with those derived from the distribution p in (j4.26p . Very good agreement is found 
for moments of the form < xfy^ >, even at high orders. Comparing the high order connected 
moments between degrees of freedom with both subscripts 1 and 2 seems to require longer run 
times than we have done at present. Numerical results for a few moments are recorded in table 
2. 



•■^'•^iH^'^ 






s 




' 






S/ * 


&••• 






Iw^b' 


W'- 


* .^'Jvl 






Kf^A*' 


ti** ♦•S 








*uv«a| 






r ' v* ' 








»."•' 







■V7^l? 



Im 






Figure 4. Projections to the {xi,yi) and (j;i, 2:2) planes of points in phase space space generated 
by the chaotic trajectory observed at intervals At = 4 (on the left) and randomly according the 
probability distribution (J4.26P (on the right). 
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Moments 


Dynamics 


Monte Carlo 


< x(> 


0.1285 


0.1290 


(< xt>-3< xf >'')/ < xf >' 


-0.6326 


-0.6098 


(< xlvi > - <xi><y( >)/ < x'i >< y'i > 


-0.05425 


-0.05788 


< x\yl > 


0.0001276 


0.0001287 


< x{^y« > 


3.283 X 10"*^ 


3.277 X 10"*^ 


< x'fx'2 > — < x'l >< x'2 > 


-0.0001122 


-0.0001387 


< y'lvi > - <yi><y2> 


-0.0001884 


-0.0001958 









Table 2. The entries in the column labeled 'dynamics' were obtained by numerical simulation of 
the dynamical system. With the exception of the last two rows, the time duration was 20000, 
with data sampled at intervals At = 2, starting from the initial conditions (rri, 7/1,2:2,2/2) = 
(0.1,0.2,0.11,0.09). The last two rows were obtained by sampling at intervals At = 4 over a 
duration 400000. The column labeled 'Monte Carlo' was obtained by hit and miss Monte Carlo 
computation using the proposed exact distribution with 100000 accepted data points, for all but 
the last two rows. The last two rows were obtained with 400000 accepted data points. 

5 Non-polynomial distributions 

In the previous section we considered invariant distributions which were polynomial, with real 
zeroes forming a compact manifold. The inverse method may be readily generalized to more 
complicated analytic structures. 

For example, consider distributions of the form, 

p = Pe-^ , (5.31) 

where P and Q are polynomial. To insure that v is polynomial, we now choose an A^ — 2 form 
with the structure 



n = Ce+« , 
where ^ is a polynomial N — 2 form. Then equation (j3.13p becomes 
*v = Pdi + 2dPAC- PdQ A e . 



(5.32) 



(5.33) 



We have found numerous examples of dissipative chaotic systems of this type, for which the real 
zeros of P do not form a closed manifold. 
As an example with A^ = 3, consider 

Q = x'^ + y^ + z^ + 3xyz , (5.34) 

^ = xyzdy + y dz . 

^The path integral measure in quantum field theories is often of this type. Note however that the 
domain of support may be restricted (for the ergodic measure) in a way which does not occur in quantum 
field theory. 
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Planar projections of points generated by the resulting dynamical system (I5.33P (observed at 
sufficiently long intervals) and by random sampling according to the probability distribution 
(|5.3ip appear consistent (see figure 5) upon restricting the domain of support of the probability 
distribution to y > and z > 0. 




• • # .1 



• ^•. 












Figure 5. The XY and XZ projection of points (on the left) generated by the dynamical system 
defined by (j5.34p . observed at time intervals At = 1 starting from the initial condition (x, y, z) = 
(0.1,1.1,0.4), and points (on the right) generated by random sampling with the probability 
distribution ()5.35p . 

Comparing connected momentqj associated with the probability distribution 



p = (1 - x^ - z6)e-(^ +^ +^ +3^^^) for x^ + z^ < 1, y > 0, z>0 
p = elsewhere. 



(5.35) 



with moments generated by the chaotic trajectory suggests that the two agree, (see table 3). 



'< xy >c=< xy > — < X >< y >, 



< xyz >c—< xyz > — < xy >c< z > — < xz >c< V > — < yz >c< x > — < x >< y >< z >, etc. 
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Moments 


Dynamics 


Monte Carlo 


< X > 


-0.08497 


-0.09152 


<y> 


0.4898 


0.5046 


< z > 


0.3712 


0.3813 


< x^ >c 


0.1697 


0.1685 


<y' >c 


0.1052 


0.1028 


<z^>. 


0.06145 


0.05809 


< xy >c 


-0.01830 


-0.01887 


< XZ >c 


-0.01304 


-0.01221 


< yz >c 


0.001292 


0.0033309 


< x3 >, /(< x2 >,)3/2 


0.1953 


0.1946 


<y'>c/i<y'>c?^' 


0.4361 


0.4119 


< Z^ >e /(< Z' >cfr^ 


0.3828 


0.3027 


< xyz >c /V< x^ >c< y^ >c< z"^ >c 


-0.07400 


-0.07370 


<x^>c / <x^ >'i 


-0.7019 


-0.7433 









Table 3. Entries in the column labeled 'dynamics' were obtained by mumerical simulation of 
the dynamical system over a time duration 40000 , sampling at intervals At = 0.1, starting from 
the initial conditions {x,y,z) = (0.1,1.1,0.4). The column labeled 'Monte Carlo' was obtained 
by a hit and miss Monte Carlo calculation using the probability distribution (|5.35p with 400000 
accepted data points. 



Note that the distribution (j5.35p seems to accurately reproduce the connected moment 
< xyz >c of the chaotic trajectory, which would not be expected if (j5.35p only described 
the statistics of the trajectory upon planar projection. This could mean that the dimension 
of the chaotic invariant set, which we have not yet made an effort to calculate, is very nearly 
three. If not, then perhaps (j5.35p has an interpretation as the Fourier transform of the the Hopf 
functional 



1 r 

^(i) = Jim 77; / dt exp(ij • x{t)) 

T^oo 1 Jq 



(5.36) 



and therefore determines all polynomial moments < x^y'^z >, although it must fail to give some 
other expectation valueql|. This assumes that the Hopf functional is sufficiently well behaved 
that its Fourier transform has support in A^ dimensions. 

This particular chaotic system behaves both as a repeller and attractor, depending on the 
initial conditions, trajectories outside with x^ + z® > 1 can never enter the chaotic invariant 
set. On the other hand initial conditions with x^ + z^ < 1 and large z are rapidly drawn into 
the region depicted in figure 5. 

Although we will not give explicit examples here, the inverse approach can also be applied 
to distributions with significantly more complicated analytic structure. For instance, one can 



^One can always describe a distribution with support over a d-dimensional subspace of an N di- 
mensional space in terms of a distribution p with support in N dimensions together with a projection. 
However p will only accurately determine expectation values of a subset of functions f{x) on the N 
dimensional phase space. 
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take a distribution of the form 

P = ^e(-^3m) ^ (5.37) 

where Pi are polynomials, together with the N — 2 form 

^ = p2p2g(-^3/P4)^^ (5.38) 

where ^ is a polynomial N — 2 form. Then the velocity field v = *dA/p will be polynomial. One 
must then verify that the distribution (or projected distribution), with some restricted domain 
of support, is ergodic. Although ()5.37p may have real poles and essential singularities, these 
present no problem if they are integrable or lie outside the domain of support of the ergodic 
distribution. 

6 A remark about non-uniqueness of p and conserved 
quantities 

Suppose that there is a variation p^p + 6p,A^A + 6 A under which the dynamical system 
V = *dA/p is invariant. This requires that 

-^dA + d(5A)=0. (6.39) 

P 

Taking the exterior derivative of this expression gives 

dAAdA = 0, (6.40) 

P 

or equivalently 

dAA*v = 0. (6.41) 

P 

The last equation implies that 6p/p is a conserved quantity. 

Note that in two dimensions, ^ is a zero-form and ()6.39p always has a solution: 

^-^ = eA, 
P 

6A = -eA^ , (6.42) 

where e is an infinitesimal constant. Since J 5p must vanish, A must have zero mean with 
respect to p. This can always be arranged by taking A — > A— < A>, which does not change 
the dynamical system. The existence of this solution is a reflection of the fact that there can 
be no chaos with just two degrees of freedom. Any non-trivial invariant distribution p \s a. 
distribution over closed orbits on which A is constant, but does not describe the statistics of a 
system with a given initial condition. 

In some instances (in any dimension), the invariant probability distribution p used to reverse 
engineer a dynamical system will not characterize individual trajectories because of the existence 
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of conserved quantities. This does not necessarily exclude chaos, unless the number of conserved 
quantities is too large. The distribution p can then be interpreted as a product of distribution 
over conserved quantities (which can be arbitrary) and a distribution which is dependent on the 
dynamics. 

As a word of caution, not all conserved quantities associated with non-uniqueness of the 
invariant distribution p impose strong constraints on trajectories. Suppose for example that a 
dynamical system admits two invariant distributions pi and p2 with different non-overlapping 
but contiguous domains of support. Then there is a class of non-ergodic distributions of the form 
xpi + {l — x)p2 where < x < 1. The associated conserved quantity is {pi — P2) / (pi + P2) , which 
is 1 in the region of support of pi and —1 in the region of support of p2- The only constraint 
this conserved quantity places on trajectories is that they can not go from the interior of region 
1 to the interior of region 2, or vice versa. 

7 Exponential distributions with Gaussian random 
forcing and Chaotic/Stochastic quantization 

Consider the static Fokker-Planck equation for a dynamical system in the presence of a Gaussian 
random force; 

d*{pv-rdp) = 0. (7.43) 

One can always (locally) write 

*{pv-rdp)=dA, (7.44) 

for some N — 2 form A. Equivalently; 

v = -rdA + Tdp). (7.45) 

P 

Assuming p = exp(— Q) and A = ^exp(— Q), where Q is a polynomial and ^ is a polynomial 
N — 2 form, (j7.45p becomes 

v = *(^dC-dQAC)- TdQ . (7.46) 

The case ^ = is well known to quantum field theorists and arises in the context of stochastic 
quantization of a field theory with action Q [10]. The dynamical system in this case has fixed 
points where dQ = with quantum fluctuations arising from Gaussian noise. Allowing non- 
trivial choices for ^ gives a infinite class of possible quantizations. In the deterministic case, 
r = 0, one must take care that ^ is chosen such that the the dynamical system is chaotic. 

As a highly speculative remark intended for quantum field theorists, we suggest that there 
may be an advantage to considering deterministic chaotic quantizations for which the distribu- 
tion exp(— Q) is not ergodic. It has been noted earlier, in section 3, that the initial distribution 
p used in the inverse method may have symmetries which are not reflected by the dynamics. 
Phenomena in quantum field theory such as spontaneous symmetry breaking might be naturally 
encoded in the two-form *^, whereas stochastic quantization (with ^ = 0) does not naturally 
give rise to symmetry breaking (see [8l [9] for potentially related discussions). If exp(— Q) is 
not ergodic, one must make sure that the Schwinger action principle equations which define 
quantum field theories are still satisfied. 
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8 Conclusions 

We have demonstrated an inverse method to construct chaotic dynamical systems starting from 
analytic expressions for an invariant probability distribution and a two-form. In principle, the 
inverse method can be used to generate an unlimited number of chaotic systems together with 
very well motivated conjectures for their exact statistics. 

At present, the examples of dynamical systems we have considered are not physically moti- 
vated and in some cases are very complex, having a large number of terms in the components of 
the velocity field. The next challenge is to attempt to reverse engineer systems close to ones of 
physical interest. It would ultimately be very interesting to apply the inverse method to physical 
systems with a very large number of degrees of freedom, such as fluids. The most difficult part of 
reverse engineering a physical system seems to lie in choosing the two-form, which has no direct 
physical interpretation. Choosing a probability distribution is easier; one could, for instance, 
choose a distribution resembling that of a fiuid with some mean shear. 

Thus far, we have studied systems with only three or four degrees of freedom. Equations of 
the form (j3.13p can be evaluated very quickly by hand or by computer, depending on the system, 
even for very large numbers of degrees of freedom. Potential computational problems arise only 
when trying to determine the domain of support of the ergodic distribution. At present, we do 
not have a way to do this besides direct numerical simulation of the dynamical system, which 
requires more computer time. However, allowing for this computer time, one should also be able 
to make very well motivated conjectures about the exact statistics of chaotic dynamical systems 
with a very large number of degrees of freedom. 

Given an exact invariant distribution p, there are novel ways to compute time-series power 
spectra which will be discussed elsewhere. In particular, one can compute the power spectra by 
Monte-Carlo methods which are readily parallelizable. Moreover, it should also be possible to 
give analytic expressions for the asymptotic behavior of the power spectrum at high frequency. 

While we have focused on developing an inverse method for dynamical systems on M^ with 
polynomial velocity fields, it may also be possible to consider more complicated phase space 
topologies such as S^ (^ M^, which are relevant to classical spin systems. It might also be 
interesting to reverse engineer dynamical systems on the N-simplex, which arises in the context 
of evolutionary biology. 

We wish to emphasize that even un-physical chaotic systems and their exact statistics, con- 
structed by the inverse method, have an important use. Such systems can provide a testing 
ground for theoretical ideas. Moreover they can serve as benchmarks upon which various ap- 
proximation methods, such as cumulant expansions and closure schemes for equations satisfied 
by mean quantities, can be tested. 
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